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ABSTRACT 

A mixture of failure rates can be present in an apparently 
homogeneous population of ''devices" due to variability either 
in their manufacture or in the severity of their service en- 
vironments. An initial mixing distribution is the probability 
distribution for different failure rates in such a population. 
This distribution may be updated to yield its related residual 
mixing distribution , which is the probability distribution for 
different failure rates in the population of survivors after 
a specified period of service or "burn-in." Residual mixing 
distributions resulting from arbitrary mixtures of constant 
failure rates are shown to be stochastically ordered (decreas- 
ingly) as the period of service or burn-in is increased, and 
to approach in the limit a distribution degenerate at the 
smallest failure rate "present" in the population. Properties 
of expected value ordering, stochastic ordering, failure rate 
ordering and likelihood ratio ordering are investigated to 
show that, of these, only likelihood ratio ordering between 
two initial mixing distributions is sufficient to guarantee 
an ordering between the expected values of their respective 
residual' mixing distributions over time. 
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SUMMARY 



It is well-known that the failure rate function for 
arbitrary mixtures of exponential life distributions decreases 
over time, approaching as a limit the smallest failure rate 
positively present in the mixture. 

It is shown here that the sequence of residual mixing 
distributions which describes the distribution of failure 
rates present in the mixture 'of survivors is not only decreas- 
ing in expectation over time, but is also a stochastically 
decreasing sequence, degenerate in the limit at the smallest 
failure rate present in the mixture. Accordingly, for any 
particular value, the proportion of items present in the 
population of survivors having failure rates greater than 
that value decreases over time. This strengthens the notion 
that the shorter- lived members of the population are being 
"weeded out." 

Should it be possible to alter the initial distribution 
of failure rates present in the mixture, one would seek an 
alteration which would be better than the original mixture, 
not only initially, but over time as well. A reasonable way 
to measure "better" may be found in the failure rate function 
of the mixture. That is, one might seek an alteration to the 
original mixing distribution which would lead to a reduction 
in the mixture failure rate function over time. 



7 



In seeking to find conditions on the alteration sufficient 
to guarantee the above- described improvement, several order- 
ings among the initial mixing distributions are considered. 

They are, listing from weakest to strongest, expected value 
ordering, stochastic ordering, failure rate ordering, and 
likelihood ratio ordering. The results of this investigation 
show that, of the orderings considered, only likelihood ratio 
ordering is sufficient to guarantee the desired improvement. 

Likelihood ratio ordering is shown to be equivalent in the 
continuous case to distributions of Polya Type II. This result 
indicates that many of the more commonly encountered distribu- 
tions belong to this class, with the gamma distribution being 
a convenient and relevant example. Gamma mixtures of expo- 
nentials are employed in reliability evaluation for the 
Trident Missile program. 

It is shown that, in an n-point discrete mixture, to 
achieve the desired improvement by shifting mass from one 
failure rate to a smaller one, the mass must be removed from 
the largest failure rate and added to the smallest failure 
rate. In the use of this mixture to describe the procurement 
of items from n different sources, this result states that 
simply shifting mass from one source to a better one will lead 
to a mixture which will exhibit a loiver initial failure rate, 
but a higher subsequent one. One must shift mass from the 
poorest source to the best source to prevent this subsequent 
crossover between mixture failure rates. 
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I. INTRODUCTION 



A. BACKGROUND 

Mixtures o£ probability distributions have intuitive 
appeal in a number of diverse applications of probabilistic 
models. Their use has spanned many years, dating back to 
before the turn of the century, for example, Karl Pearson's 
work in 1894 [1] . The breadth of their potential use was 
indicated by Feller [2] in saying that "every distribution 
may be represented as a mixture." 

As indicated by Blischke [3] , two types of problems 
associated with mixtures of distributions have received much 
attention in the literature. They are the problems of identi- 
fiability and parameter estimation. 

The problem of identif lability is one of unique character- 
ization. As defined by Teicher in [4] , for F = {F} a family 
of distributions, a p-mixture of F, say H, will be called 
identifiable if for any probability measure y*, the relationship 



implies that y = y*. Other investigations into the identifi- 
ability of mixtures are given in [5], [6] and [7]. 

Given whatever assumptions one is willing to make concerning 
the families of distributions which may be involved in the 
mixture, the specifying parameters of those distributions must 
generally be estimated from sample information. Cohen and 
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Falls [8] provide a good example of this sort of investigation. 
They examine estimation procedures in a number of different 
mixtures, including mixtures of two Poissons, two exponentials, 
and two Weibulls. Their specific application is in the analy- 
sis of atmospheric data. Mixtures of binomials are examined 
in [3] and [9], the latter with the field of advertising as 
an application. Parameter estimation for mixtures of expo- 
nentials is treated in [10] and [11]. 

This thesis treats general mixtures of exponentials. The 
recognition of such a mixture as a Laplace-Stielt j es transform 
guarantees its identif iabil ity due to the uniqueness of deter- 
mining functions of such transforms as asserted in [12] and [2]. 
The purpose of this effort is to investigate the properties of 
such a model with emphasis on the interpretation and applica- 
tion of results in the reliability context. 

The results in chapter II are essentially those reported 
earlier by the author in [13] . 

B. THE MODEL 

The model we shall consider is a mixture of the form 

(1.1) F(t) = jg e'^^ dG(A), t > 0 

= P(T > t), 

where F(t) is the survival function of the random variable T. 
F(t;X) = e is the survival function of the component dis- 

tribution given that A = A for A a nonnegative random variable 
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having cumulative distribution function G. We can refer to 
such a mixture as a G-mixture of exponentials. 

We take the usual definition for a failure rate function 
as given in [14], i.e., for the random variable T having 
density f(t] and survival function F(t), the failure rate 
function h(t) is defined by 

£(t) 

h(t) = , for all t such that F(t) > 0. 

F(t) 

The initial mixing distribution G may be modified to yield 
a related distribution indexed according to the value of t _> 0, 
i.e., let G^(X] = P (A _< X|T > t) and define A(t) to be a random 
variable having cumulative distribution function G^, which we 
recognize to be a conditional distribution for A, given that 
T > t. The relationship between a mixing distribution G and 
its corresponding distribution G^ is given by a straightforward 
application of Bayes' Theorem which yields 

-Xt 

(1.2) dG. (X) = ■ dG(X), 

^ E(e*^^) 

where the expectation is with respect to G, the distribution 
of A . 

We shall find it necessary to consider alternative mixing 

random variables, for example, A^^ and A 2 » We associate with 

each random variable A. its distribution G- and its corre- 

1 1 

sponding conditional distribution G. ^ as above. 

a > t 
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C. THE RELIABILITY PERSPECTIVE 



In the reliability context for the expression (1.1), T 
represents the time to failure of an item drawn at random 
from a population of items having different exponential life 
distributions, mixed according to G, the distribution of A. 

The exponential distribution has been widely employed in 
modeling random lifetimes, due largely to its tractability 
and to the fact that it is the limiting life distribution of 
complex equipment as the complexity and time of operation 
increase. The assumption for the latter result is essentially 
that the lifetime of the equipment is a superposition of many 
renewal processes [14] . 

The failure rate of such equipment may be considered to 
be related to both quality of manufacture and service environ- 
ment [15]. Thus, the consideration of both variability of 
manufacture and variability of service environment leads, 
individually and jointly, to the choice of a mixture of com- 
ponent distributions as the description of the life distri- 
bution of an item drawn at random from such a population. 

The use of the Stieltjes integral [12] admits continuous, 
discrete, or mixed, distributions G. 

The conditional distribution for A, given that T > t, G^, 
is the residual mixing distribution at time t. It represents 
the revised distribution for the failure rate of an item 
randomly drawn from the mixture, given that the item is still 
functioning at time t. As an item continues to survive it 
admits a continual updating of the information at hand 
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concerning the mixture from which it was drawn. also 

represents the relevant mixing distribution for an item 
randomly drawn from the population of survivors at time t. 

For such a G-mixture of exponentials it is well known [16] 
that the mixture failure rate h(t) is decreasing in t (we 
shall use 'decreasing' for non- increasing and 'increasing' for 
non-decreasing] , and that the mixture failure rate approaches 
as a limit, with increasing time t, the least of all parameter 
values present in the mixture [17] . 

Aldrich and Morton [18] and 0-Bar [19] showed that at time 
t the failure rate function of a G-mixture of exponentials is 
the expected value of the residual mixing distribution corre- 
sponding to that time, i.e., 

(1.3) h(t) = E[A(t)]. 

Thus, the sequence of residual mixing distributions is decreas- 
ing in expectation. This fact supports the intuitive notion 
that with increasing time the shorter- 1 ived members of the 
mixture are being "weeded out." O'Bar [19] also showed that 
the slope of the mixture failure rate function over time is 
related to the variance of the residual mixing distribution 
by 

h' (t) = -VAR[A(t)] . 



D. EXAMPLES 

1 . Two-Point Discrete Mixture 

This represents the simplest discrete case. Here, 
G is defined for < X 2 by 
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! X^, with probability 
X 2 , with probability p 2 * 



This could be thought of as a two-vendor situation, or a 
single-vendor situation with two distinct service environments. 

As developed in [19] , the mixture survival function is given 
by 

F(t) = P(T > t) 

= P(A = X3^)PCT > t|A = + P(A = X2)P(T > t I A = X 2 ) 

= Pj^e ^1^ + P2e'^2^. 



The mixture failure rate function is 

Pi At e ^ 

h(t) 

(1.4) 



, fill , Pi^P 

F(t) Pi e'^1^ + 



1 ^ 1 - (X^ - Xi ) t 

Pi Xi + P 2 X 2 e 2 1 



p^e 



■ ( X 1 X 1 ) t 



The conditional probability that the item was drawn from 
component distribution 1, given that it is still functioning 
at time t, Pi (t) , is given by 

Pi (t) = P(A = Xi |T > t) 

P(A = Xi,T > t) p(T > t|A = Xi)P(A = Xi) 
P(T > t) P(T > t) 

Pie'^1^ _ 1 ^ 

PlO’^l^ + P2e ^2^ Pi + P2 e ^^2 
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The conditional probability that the item was drawn 
from component distribution 2, given survival to time t is 




p^ (t) and P 2 Ct) ^.re called the residual mixing probabilities 
and can also be interpreted as the proportions of items with 
the component failure rates and X 2 in the population of 
survivors at time t. The residual mixing distribution is 
then defined by 



Note that p^^ (0) = p^^ and P 2 CO) “ ?2 • As t increases, Pj^ (t) 
increases from p^^ to 1 and P 2 (t) decreases from P 2 to 0. 

2. Gamma Mixture 



primarily to its tractability . For example, see [15] and 
[20]. Here, A has the density 



A(t) 



X^, with probability p^ (t) 
X 2 > with probability P 2 (t). 



This is a frequently cited continuous model, due 




, for a , 3 , X > 0 . 



The mixture survival function is 
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FCt) = P(T > t) = \ e‘^^g(X)dX 

■*0 



Q rcct) 



8^ r IB^ 

(3 + 'o 

T(t) = ^ i »• 

The mixture failure rate function is given by 

h(t) = 

(1.5) 

a 

" T~r~E 



The residual mixing density is 



gtCx) = 



e'^^g(X) 



F(t) 

_ re + ti“ 3^ 

■ L“3“J rro 



^ x“‘^e ‘ 



_ (3 + t)*^ ^a-lg-(3+ t)X 
r (ct) 



which is itself a gamma density with parameters a and (3+t). 
It represents the density for the distribution of failure 
rates in the population of survivors at time t. The relation- 
ship between G and in this case is 
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5 ' 




3 + t 

that is, A(t) may he obtained from A by a change of scale. 
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II. STOCHASTIC ORDERING IN RESIDUAL MIXING DISTRIBUTIONS 



A. INTRODUCTION 

As mentioned in section I.C., the fact that the sequence 
of residual mixing distributions is decreasing in expectation 
leads to a conjecture of a compatible stochastic ordering of 
such a sequence. In this section the existence of such a 
stochastic ordering is demonstrated. It is also shown that 
the residual mixing distributions converge in distribution to 
the distribution degenerate at the least parameter value 
positively present in the mixture, with an attendant monotone 
convergence of raw moments. The latter result is one asserted 
by Aldrich and Morton [18]. 

The results are presented as applications of Propositions 
2.1 and 2.2, to be developed in the next section. These propo 
sitions state properties of E{u[A(t)]} for fairly general 
functions u. To indicate the relevance of these propositions 
we first note that an expression of this form is involved in 
(1.3), taking u[A(t)] = A(t). We next define an indicator 
function 




0, K < X 



( 2 . 1 ) 



1, A > X 



Using this indicator function, G^ may be expressed as 



( 2 . 2 ) 
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another expression of the same form, with u[A(t)] 



B. BASIC RESULTS 



We shall develop in Propositions 2.1 and 2.2 of this 
section basic tools which should prove to be useful in a wide 
variety of applications. Several of these applications are 
given in section II. C. 

Using (1.2) we find that 



E{u[A(t)]} = ^ u(X)dG^(X) 



(2.3) 






u (X) e 



X t 



0 E(e'^^) 



dG(X) 



E[u(A)e’^^] 

E(e'^^) 



Thus, expectations of functions of A(t) may be evaluated by 
simply taking expectations of functions of A. A straight- 
forward application of the Monotone Convergence Theorem yields 

^ {E[u(A)e’^^]} = E[u(A) ^ e’^^J 

(2.4) 

= -E [Au (A) e , 

for A ^ 0. 

We next require the function u to be nonnegative and 
monotone to get 

PROPOSITION 2.1. If A is a nonnegative random variable and 
u a nonnegative monotone increasing (decreasing) function, 
then 
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= E{u[A(t)]} 



^ E(e 

is monotone decreasing (increasing) in t. 



Proof : Using (2.4), 



— ft') 
dt 



E(e~^^)E[-Au(A)e~^^1 - E fu (A) e'^^1 E [ - Ae~^^] 
E(e'''^^) ^ 



ErAu(A)e~‘^^1 ^ E[u(A)e~‘^^1 
E(e'^^) E(e‘^^) 



E(Ae~^^) ~ 
LE(e'^'^) . 



= E{u[A(t)] }E[A(t)] - E{A(t)u[A(t)] } 

= - C0V{u[A(t)] , A(t) }. 

Then, by the property of the covariance of similarly/dissimi- 
larly ordered functions of the same random variable. 



(i) 


u increasing in 


A(t) 




4>u(t) 1 and 


(ii) 


u decreasing in 


A(t) 




4>u(t) >0. D 



We now need two lemmas regarding limits of expectations 
involving time t as a parameter. 

LEMMA 2.1. Given u a nonnegative function, 

lim E[I- (A)u(A)e‘ = 0. 

t-)-oo ^ 

Proof: Note that I-v (A) = 1 <s> A - A > 0 <=*> e" ^4 in t. 

An application of the Monotone Convergence Theorem yields 

lim E[I^(A)u(A)e’ = 0. D 
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LEMMA 2.2. For A > = inf { A | G (A) < 1 } , 

iim E[C1-I, > 0. 

t->OQ ^ 

Proof : Note that (l-I^(A)) = 1 <i^ A - A _< ^ 1 

for t > 0. Then, E[ Cl-I^ (A) ) e' >E[1-I^(A)] =G(A), 
and lim E [ (1- 1 , (A) ) e’ > G(A) >0. 0 

t-i-OO 

If, in addition to the monotonicity requirement of 
Proposition 2.1, we also require u to be right-continuous 
at A^, we may find the limiting value of 4>y(t) as t ^ 

We state this result in 

PROPOSITION 2.2. Let A be a nonnegative random variable 
having cdf G, and u a nonnegative monotone increasing 
(decreasing) function. If u is right-continuous at 
A^ = inf{A|G(A) <l), then decreases (increases) 

monotonically to u(A^) as t-^“. 

Proof: 

(i) If u(A)f in A then 4>y(T) ^ u(A^). By Proposition 

2.1, <f'„(t)+ in t. Thus, lim 4> (t) exists and lies in 
the interval [u(A^) ,“) . Choose A > A^. Then, 

E[(l-I (A))u(A)e'^^] + E[I (A)u(A)e'^^J 

^ :it ^ ^At 

E[Cl-I;^(A))e + E[I;^(A)e 

E[Cl-I,(A))u(A)e'<^“'^^^] + E[I^(A)u(A)e’^^'^^^] 
E[(l-I^(A))e~'^^’^^^] + E[I;^(A)e’‘^^’^^^] 

Since u(A)f in A, 
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E[(l-I;^(A))e'^^'^^^] + E[I^CA)e'‘^^'^^^] 



< u(X) + 



E[I^(A)u(A)e'^^'^^^] 



E[Cl-I;^(A))e'‘-^'^^^] + E[I^(A)e 



-(A-X)t^ ’ 



( 1 ) 



Lemmas 2.1 and 2.2 may be applied to show that the last term 
in expression (1) goes to zero as t ^ Therefore, . 

lim (|) (t) < u(X). Let XIX to get lim 4) (t) £ u(X ). 

then, 4>^(t) + as t -»■ “. 

(ii) The proof for u monotone decreasing is similar to 



C. APPLICATIONS 

The first application of the tools developed in the 
preceding section concerns the stochastic ordering of the 
sequence of residual mixing distributions and its limiting 
distribution, stated as 

Theorem 2.1. If A is a nonnegative random variable with cdf 
G and = inf {X | G (X) <1} , then for a G-mixture of exponentials 

a) G^ is a stochastically decreasing sequence in t, i.e.. 



that above. 



0 




1 



(X) > G (X) , for all X. 
~ 2 



b) G^ converges in distribution to the distribution 
degenerate at X^, as t 
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Proof : 



a) By (,2.2), 



G^iX) = EdJACt)]}. 



Note that is monotone increasing in its argument. 

Application of Proposition 2.1 with u[A(t)] = I^[A(t)] 
yields in t. 

b) Application of Proposition 2.2 with u[A(t)] = I^[A(t)] 
yields as t ^ 



This result strengthens the statements which can be made 
about the population of survivors at time t. It was previ- 
ously known that ^ sequence decreasing in expectation. 

Now, in addition we may see that, given any value A, the 
proportion of items in the population of survivors having a 
failure rate exceeding X (indicated by G^(A)) is decreasing 
over time. This relationship is clearly indicated in the 
examples of section I.D. by the monotonicity of the residual 
mixing probabilities in the two-point discrete mixture, and 
in the gamma mixture, by recalling that the relationship be- 
tween A and A(t) is 




D 
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Then, for < t 2 > we have 



G, CA) 



1 




> P[A >-y-X] = P[A(t2)>A] 




CA). 



2 



An immediate consequence of Proposition 2.2 is the well 
known result that a mixture of exponentials is DPR, with its 
failure rate approaching the least parameter value positively 
present in the mixture. We state this result as 

Theorem 2.2. If A is a nonnegative random variable with cdf 
G and = inf{X |rT(A)<l} , then for a G-mixture of exponen- 
tials the mixture failure rate function, h(t), decreases 
monotonically to X^ as t -»■ «>. 

Proof: As noted in (1.3), 



h(t) = E[A(t)]. 

Application of Proposition 2.2 with u[A(t)] = A(t) yields 



This result may be seen to hold in the examples of 
section I.D. by noting the expressions found for h(t) in 
(1.4) and (1.5). 

We may also see the monotone convergence for the raw 
moments of the residual mixing distribution in 

Theorem 2.5. For p > 0, E[A(t)P] decreases monotonically 



the desired result. 



0 



to X^ . 
o 
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Proof : Application of Proposition 2.2 with u[A(t)] = A(t)P 



yields the desired result, [] 

The variance of A Qt) is of interest, since it has an 
interpretation as the negative of the slope of the mixture 
failure rate function [O'Bar, 19], We state the following 
as 

Corollary 1. The limit as t “ of VAR[A(t)] is zero. 
Proof : We express the variance of A(t) as 

(2.5) VAR[A(t)] = E[A(t)^] - E^[A(t)] 



Then, by Theorem 2.3, 

lim VAR[A(t)j = = 0 . D 

t->oo o 0 

Expression (2,5) leads us to 



Corollary 2. On the interval (0,°°), VAR[A(t)] is of bounded 
variation. 

Proof : From the power series expansion for e^^, we have that 



A 



n 



n ! At 
— e 

t^ 






for n a nonnegative integer. Thus 



E[A(t)^] 



E[A^e'^^l ^ E[e^^e'^^] 

E(e'^^) t^ Efe'^^) 



< 



n ! 

t^E(e"''^^) 



for t > 0. 
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Then, from expression (2.5) and Theorem 2.3, since VAR[A(t)] 
is expressed as the difference of two real-valued nonnegative 
monotone functions for t > 0, it is of bounded variation on 
(0,00). Q 
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III . ORDERINGS OVER TIME AMONG DISTINCT 
G-MIXTURES OF EXPONENTIALS 

A. INTRODUCTION 

Chapter II dealt with the behavior over time of the 
sequence of residual mixing distributions corresponding 

to a single given mixing distribution G. 

The applications of the model (1.1) in a reliability 
context prompt questions regarding orderings among distinct 
initial mixing distributions G^ or the creation of some other 
such ordering between their corresponding residual mixing 
distributions G. over time. Specifically, if the initial 

1 , t 

mixing distribution can be altered, what conditions upon the 
alteration can guarantee that the altered mixture would be in 
some sense better uniformly over time? This chapter contains 
some results in this direction. 

B. BASIC RESULTS 

We examine several orderings, their properties and their 
interrelationships in sections III.B.l through III.B.4, 

1 . Stochastic Ordering 

We take the usual definition for stochastic ordering 
as employed in Chapter II; that is, two random variables are 
stochastically ordered if and only if their survival functions 
exhibit that ordering, 

^2 ^ ^1 — ^2 
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Another useful characterization of stochastic order- 
ing states that A 2 E [u(A^) ] _< E[u(A 2 )], for all 

u monotone increasing. This characterization follows directly 
from a lemma by Lehmann [21, p. 73] which states that 

only if there exist two monotone increasing 
functions f^ and f 2 and a random variable V, with 
fj^(v) £ f2("'^) for all V and A^^ A 2 ='^^f 2 (V). 

That E[u(Aj)] £ E[u(A^)] is a necessary condition follows 
from noting that E[u(Aj^)J = E[uf^(V)] £ E[uf 2 (V)] = E[u(A 2 )]- 
That it is sufficient also may be seen by taking 





( 


if A > X 


u(A) = I^(A) 








' 0 , 


if A £ X . 


An equivalent characterization is 


A, 


A 2 E [u(A 



£ E[u(A 2 )]> for all u monotone decreasing. 

2 . Failure Rate Ordering 

We define a failure rate ordering between two random 
variables by 



(3.1) 



A, <<^^A. «^:>E [I (A-,AJ - I ,rAT,A_)l > 0, 

1 — 2 p*- u,v^ 2’ !■' UjV'- 1 ’ 2^' — ’ 



where for u > v the indicator function I is defined by 

LI « V 



(3.2) 



I 

u,v 



(x,y) 



1, ifx>u,y>v 
0, otherwise 



and where E 

P 



indicates an expected value with respect to 
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the product measure of and ^2 for and inde- 

pendent. We show the equivalence of the definition above and 
an ordering of failure rate functions where they exist in 



Lemma 5 . 1 . Given two random variables, A^^ and 
failure rate functions h^ and h2 respectively, 

h^(X) > h^CX) for all X A^ ^ 2 ’ 

Proof : C *>) Suppose h^(X) ^ h2(X) for all X. 

u > V, 



V h^(s)ds ^ \ h2(s)ds 
*^v "^v 



exp - \ h^(s)ds <_ exp - \ h2(s)ds 
■^v ‘'v 



G^(u) G2 (u) 

G^(v) “ G2 (v) 



G2(u)G^(v) - G2(v)G^(u) > 0 



P(A2 > u)P(A^ > v) - P(A2 > v)P(Aj^ > 

E [I (AojAi) “ I (At>A-i)] > 0 
p u,v^ 2* 1 ^ u,v^ 1 2'^-' — 



A2, with 
then 



Then, for 



> 0 



) 



Reverse the above steps. 



D 



3 . Likelihood Ratio Ordering 



We define a likel ihood ratio ordering between two 
random variables by [cj) (A 2 ,A ^ 0 for all 

functions (j> such that (j>(x,y) = -<J)Cy»x), and 4>(x,y) 
for X ^ y. 

This ordering is equivalent, in the case where the 
random variables have densities, to the assertion that A^^ 
and A 2 belong to a family of densities having monotone 
likelihood ratio [21] . Other characterizations of this 
ordering in the continuous case are given in [22] and [23]. 
These state that A-^ and A 2 are said to be totally positive 
of order two , or Polya type I I if and only if 



§1(^1) 


gl (^2) 


g 2 (^l) 


£2(^2^ 



0, for < A 2 « 



Equivalently, that 



(3.3) 



§1 ^^2^ £2^^^ 



for < X 2 * 



We show the equivalence of the definition given for 
likelihood ratio ordering and equation (3.3) in the continuous 
case in 



Lemma 3.2. Given two random variables, A^ and A 2 , with 
densities gj^ and g 2 respectively, then 
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S -] ( ^ 7 ) S 2 ^ ^ 2 ^ 

171X71 - 171^ ’ ^ ^2 ^ 



for all functions (}> such that <j)C^,y) = -<J>(y,x) and <j>(x,y) ^ 0, 
for X ^ y. 



Proof: C =^) E [4)CA2 



■VI- I 



/*oo 



4>(x,y)g2(x)gj^(y)dxdy 



0 •> 



0 



0 J 



y 



<J>(*^»y)g 2 (^)gi(y)dxdy 



<l>(x,y)g 2 (x)g^(y)dxdy 



0 ■’y 




<l>(^t,y)g 2 Cx)gj^ (y)dydx 



0 •'x 



+ 1 1 4>(x,y)g2(x)g3^(y)dxdy 

Jo Jy 

We make changes of variables of x = v, y = u in the first 
integral and y = v, x = u in the second integral to get 



Ep[^(A 2 ,Ap] = 




4 i(v,u)g 2 (v)g^(u)dudv 



0 «v 



/•CO -00 



<l)Cu,v)g 2 (u)g^(v)dudv 



0 •' 



V 

OQ 



4 >Cu,v)g 2 (v)g^(u)dudv 



0 -' V 



4> (u,v)g 2 (u)g^(v)dudv 



0 *^v 
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E f4>CA2,Ai)] = 



f” 

'|)(u,v) [g 2 (u)g^(v) - g 2 (v)g^(u)]dudv 

Q Jy 



Since u ^ v over the range of integration, the integrand is 
nonnegative by hypothesis and property two of the function <}). 



(<= ) Let 0 1 < z^. Choose Az such that 0 < Az < (Z 2 - z^) 

Let I . = f z 



(})(x,y) = 



z . + 
1 


Az] 


for i = 1,2. 


Def ine 


+1, 


for 


X £ I 2 , y 




-1, 


for 


X £ I^, y 


£ I 2 


0, 


otherwise 




) is 


shown 


in Figure 3 


.1. 




Figure 5.1. 
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Then, Ep[(|)(A2,A^)] = ? - P (A 2£l P (A ^£l ^ > 0 , 

which yields 

P(A2£l2)PCAi£li) P(A2£l^)P(A^£l2) 



” ^ 2 ^^ 2 ^ ^jl^(^2'*’Az) * Gj^(z2) 

AZ A z 

^ 2(^1 + Az) - G 2 (z^) G^(z 2 + Az) - G^(z 2 ) 

Az Az ~ 

Let Az 0 to get g 2 (Z 2 ) gj^ (z^) - g2(^i)gi(^2^ - which 
completes the proof. Q 

4 . Relationships Among Orderings 

Likelihood ratio ordering is the strongest of the 
three orderings. Its implication of failure rate ordering 
may be seen in 

Lemma 5.5. A^ ^^1 

Proof: Follows directly by defining 

4>(x,y) = 

for the indicator function defined by (3.2), and noting that 
<l)(x>y) = -4>Cy,x) and ())(x,y) ^ 0 for x ^ y. Q 

That the reverse implication does not hold may be 
easily seen by letting n = 3, j = 2 and k = 3 in the counter- 
example of section III. C. 2. a. 
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We get a direct verification of the well-known result 



that failure rate ordering implies stochastic ordering in 
Lemma 5.4. ^^1 

Proof : Follows directly by taking v = 0 in (3.1) [) 

Letting u(_A) = A in the characterization for 
stochastically ordered random variables of section III.B.l. 



with respect to 
result that 


monotone increasing u yields the familiar 




Aj =»E(A^) < ECA^). 



C. APPLICATIONS TO MIXTURES OF EXPONENTIALS 
1 , Ordering Inheritance Hypotheses 

We first formulate hypotheses asserting inheritance 
properties between orderings among initial mixing distributions 
and their respective residual mixing distributions. They may 
be stated as 

HI: E(A^) < E(A2) =>E[A^(t)] < E[A2(t)], t > 0. 



H2: A^ 


l'^^A2(t), t > 0. 


H3: A^ 


< A 2 => A^(t) < A2(t) , t > 0. 


H4: A^ 


<^^A2(t), t > 0. 



We introduce the following set identifications: 

A = {(A^,A2) 1 E(A^) < ECA 2 )} 

B = {(A^,A2) I E[A^Ct)] < E[A2(t)], t > 0} 
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C = {(A^,A2) 

D = {(A3^,A2) 

E = { CAj_ »A2) 
F = { CA^,A2) 
G = {(Aj^,A2) 
H = { (A^ ,A2) 



A^(t) < A2Ct) , t > 0} 

1 ^2} 

Aj^Ct) £ , t > 0} 

Al 

Ai(t) < , t ^ 0} 



We can now restate the hypotheses as 
HI: A C B 

H2: CCD 

H3: E C F 

H4: G C H 



We know, by letting t 0 , that B C A, D C C and F C E. Thus, 
hypotheses H1-H3 are actually postulating equivalences. We 
also know from the relationships given in section III.B.4. 
that GCECCCAandHCFCDCB. 

2 . Counter-examples to Hypotheses 
a. Hypotheses HI and H2 

We first state an additional hypothesis: 

H5: A^ ^2 ^ E[A^(t)] < E[A2(t)] , t > 0. (C C B) 

From section III.B.4. we know that C ^ A and that D C B. If 
H5 is false, then C n S' is not empty. That would imply that 
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neither A 0 S nor C fi is empty. Thus, hypotheses HI and 
H2 would be disproved. 

H5 is shown to be false as follows: Let A- = X. 

2 1 

with probability p^, i = l,...,n, where < A^ <..<A^. Then, 
for 1 £ j < k _< n, let 



A 



1 



Aj with probability 
Aj^ with probability 
A^ with probability 



Pj + e 

Pk - ^ 

P^, i 7^ j ,k 



By inspection, A^ I = {i | i e {l,2,...,n}; 
i f j>k}V Then we can write, summing from 1 to n unless 
otherwise noted, ^ 



E[A2(t)J = h2(t) 



E[A^Ct)] = h^(t) 



Ep^A^e’^iP 



fPj^A-^e'^jP + CP-j + e) Aje'^jP + CPj^ - e) A^^e' ^k^ 
fp^e'^iP + (Pj + e)e'^jP + CP]^-e)e‘^kP 



Epj^A.e'^jP eCA-e'^jP - A^^e'kP) 
Ep^e'^iP + e(e‘^jP - e'^kP) 



Assume that E[A^(t)] £E[A 2 (t)]. Then we have 



EPj^Aj^e'^jP + eCAje'^jP - A^^e’^kP) Ep^A^e’^iP 
Ep^e ^iP + e(e~^jP - e ^kP) ~ Ep^e ^iP 



Here, h^(t) and h 2 (t) are the failure rate functions for 
Tj^ and T 2 respectively. 
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Ep.e'^i^[Zp.X.e‘^i^ + £ (X - e'^' ^ - Xj^e'^k^) ] 
<_ Sp^X j^e'^i^[Ep^e'^j ^ + e(e’^j^ - e'^k^)] 



- e'H" 



< h2(t) 



(3.4) 



Aj - 
1 - 



< h^Ct) 



Taking the limit as t -»■ ® in expression (3.4), h 2 (t) X^ and 
according to Theorem 2.2, we have Xj ± Therefore, j = 1 

is a necessary condition, that is, for j 7 ^ 1 , the assumption 
that E[Aj^(t)] _< E[A 2 (t)] leads to a contradiction. Then, 
hypotheses HI, H2 and H5 are false, 
b. Hypothesis H3 

We first state an additional hypothesis: 

H 6 : Aj^ < A 2 E[Aj^(t)] < E[A 2 (t)] , t > 0. (EC B) 

From section III.B.4. we know that F C D C B. If H 6 is false, 

then E n ^ is not empty which implies that E (T ^ is not empty, 

disproving H3. 

H 6 is shown to be false by taking k = n and j / 1 
in the counter-example of section III. C. 2. a. Using the 
definition (3.1), it is easily verified that A^ £ ^^^ 2 ' 
that counter-example, however, we know that j = 1 is a neces- 
sary condition for B. Therefore, H 6 is false, disproving H3. 
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3 . Proof of Hypothesis H4 

We can go beyond hypothesis H4 and show an equivalence 
between likelihood ratio orderings in the initial and residual 
mixing distributions in 

Proposition 3.1. t ^ 0. 

Proof : f=^) From equation (2.3) we know that for a function 

u, 

E{u[A(t)]} = 

E(e'^^) 



Similarly , 



Ep{u[AzCt) ,Aj^(t) ] } = 



Ep[u(A3,A pe'<'^l*''2^^] 
Ep [e‘ 



Choose a function (f) such that i^(x,y) = ~(J>(y,x) and p(x,y) ^ 0, 
for X ^ y. Then 



Ep{(j)[A2(t) } = 



Ep[(j)(Az,A^)e~'^^1^^2^^] 

Ep[e‘^^l''^2^^] 



^ Ep[^,(A2,Ai3] 

Ep[e' 

where (p^(x,y) = (j> (x,y) e" ^ , Note that i|;^(x,y) = -i|;^(y,x) 

and ijj^(x,y) ^ 0 for x ^ y. By hypothesis, then, 

Ep[’l't(A 2 >Ai)] ^ 0, and Aj^(t) 
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Ep{({) [A2Ct) ,A]^(t)] } > 0 



Ep[(j)CA2 ] 




> 0 



Then, [(|i (A 2 , A^) ] ^ 0, and A^ ^ 2 ' 



0 



With the proof of Proposition 3.1, then, we have 



established that, of the orderings considered, only likelihood 
ratio ordering between two initial mixing distributions is 
sufficient to guarantee an improvement in the mixture failure 
rate function for any time t ^ 0. This would seem to be an 
extremely strong requirement; however, according to Karlin [23], 
most of the more common distributions belong to this class. 

The gamma distribution, in particular, is a member. We can 
show this by noting for the gamma distribution, for u > v. 



decreasing in 3- So, whether we are changing a or 3, holding 
the other fixed, the result will be two distributions which 
are likelihood ratio ordered. To see that such an alteration 
would, in fact, lead to an ordering of the mixture failure 
rate function over time, recall expression (1.5) which 
showed 




g(v) ^a-lg-3v 




We note that this expression is increasing in a and 
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4 . Shifting Mass from One Population to Another 



A conunon situation is one in which an item which fails 
according to an exponential life distribution is obtained from 
several sources or populations having different failure rates. 
The survival function for the mixture then becomes 

- n t 

FC.t) = E Pi® ^i^ 

for n populations, each having a failure rate and compris- 
ing a part of the mixture p^. An obvious way to improve the 
mixture would be to shift mass from one population to another 
having a lower failure rate. From the counter-example given 
in section III. C. 2. a, we know that in order to guarantee an 
improvement in the failure rate of the mixture uniformly over 
time (that is, for a shift from A 2 to A^, we want E[Aj^(t)] 

£ E[A 2 (t)]j t ^ 0) the population receiving the increase in 
mass must be that one having the minimum failure rate. That 
is, shifting mass to the most reliable population in the 
mixture is a necessary condition. Likelihood ratio ordering 
among initial mixing distributions was shown in section 
III.C.3. to be a sufficient condition for such a uniform 
improvement in the failure rate. 

Recall the statement of the example of section 
1 1 1. C. 2. a. As noted above, we know that j = 1. Through a 
procedure analagous to that in the proof of Lemma 3.2, using 

sums instead of integrals, it is easily seen that in this 
I h 

case for A^ -^2 have, for i > m. 
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P(A^ = A.) ^ PtA^ = Xp 

= Aj nA^ = xj ■ 

Suppose k n. Let m = k and i = n to get 

. Pn , £n , ^^'^2 ^ , 

P(Ai = Xj^) Pk ■ ^ Pk ’’'■^2 ■ 

'La, 

and £ ^ 2 ’ Then k = n and shifting mass from the worst 

population to the best population is sufficient for an improve- 
ment in the failure rate of the mixture uniformly over time. 

We note here that the intuitively appealing approach 
of simply shifting mass from a poorer population to a better 
one will not lead to a lower mixture failure rate function 
over all time. Unless the shift is made from the worst to 
the best, there will be some time at V'^hich the two mixture 
failure rate functions will cross. 

5 . Likelihood Ratio Ordering of T-| and _Iz 

We show a likelihood ratio ordering among initial mix- 
ing distributions to imply a likelihood ratio ordering of the 
opposite sense in the times to failure of the mixture, and 
Tz , in 

L,a, L,a, 

Proposition 3.2. A^ _< ^2 ^1 — '^ 2 ' 

'La, 

Proof : Suppose A^ _< Az* Define the function 

jxyCe'f>'P2 * “P - e'ty'l * ’" 2 b. tj < 

<l>Cx,y) = 

(0, 1 ^2 
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We note that <j)(x,7) = -<PCy,^) and 4>C^»y) ^ 0 for x ^ y ^ 0, 
By hypothesis, [(}> (A^ , A^) ] ^ 0. Then, for t^^ < t 2 > 

E {A^ A^[e' ^^1^2 ^2^1^ - e' ^2^2^]} > 0 

p 1 Z '■ — 



E [A A^e‘^^1^2 ^2^1^] > E [A A-e‘*^^l^l ^2^2^] 

p'-12 ■'— p'-lZ ■' 



ECA^e"'^1^2)E(A2e‘^2^1) > E(A^e‘^i^l)E(A2e‘'^2^2) 



E(A e‘‘^2^2) E(A e''^1^2) 

-A t — t ’ ^ ^2 ’ 

E(A^e E(A^e 1^1) ^ ^ 



^2 ^^2^ 

fTTf^T - fiC^i) 



, t^ < t2 



that is, T 2 ' 



0 



6 . Mean Residual Lifetime Ordering 

The mean residual lifetime at time t corresponding 
to a distribution F is 



U(t) = 



F(t) 



F(x)dx = E(t - t |T > t) 



For 



lA. 



T^ ^2’ equation (3.3) to write 



F,(x) 7’2 C.x) 

zr 1 > X > t 

F^(t) F2(t) 
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Then, 



so, if T 



y^Ct) = 




rF(x) 

-± dx < 

Jt FiCt) J, F2Ct) 

then C^) < y2Ct) . t 



dx = 



> 0 . 



y 2 ^ ^ ) > 
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